A neural model of luminance-gated recurrent motion diffusion for 2D motion integration and segmentation
نویسندگان
چکیده
We propose a model of motion integration modulated by luminance information, which is able to explain the percept on a large class of motion stimuli facing the aperture problem. This model is related to other multi-layer architectures incorporating both feedforward, feedback and inhibitive lateral connections and is inspired by the motion processing cortical areas in the primate (V1, V2, MT). Our main contribution is to propose a new anisotropic integration model where motion diffusion through recurrent connectivity between layers working at different spatial scales is gated by the luminance distribution in the image. This simple model offers a competitive alternative to models based on a large set of cortical layers implementing specific form or motion features detectors. We demonstrate that the proposed approach produces results compatible with several psychophysical experiments concerning not only the resulting global motion percept but also the motion integration dynamics. It can also explain several properties of MT neurons regarding the dynamics of selective motion integration. As a whole, the paper affords an improved motion integration model which is numerically tractable and reproduces key aspect of cortical motion integration. Key-words: dynamics, form, GPGPU, motion, perception ∗ [email protected] † [email protected] ‡ [email protected] in ria -0 03 60 27 7, v er si on 2 10 J un 2 00 9 Un modèle neural récurrent de diffusion du mouvement selon la luminance pour l’intégration la segmentation du mouvement 2D Résumé : Nous proposons un modèle d’intégration du mouvement modulée par la forme capable d’expliquer la perception d’une large classe de stimuli en mouvement dans lesquels se pose le problème de l’ouverture. Notre modèle peut être relié à d’autres architectures multi-couches incorporant à la fois des connexions montantes, descendantes et localement inhibitives, et inspirées par les zones corticales dédiées au mouvement chez le macaque (V1, V2, MT). Notre principale contribution est de proposer un nouveau modèle d’intégration anisotropique du mouvement dans lequel la diffusion entre les différentes couches travaillant à des echelles spatiales différentes est conduite par la distribution de luminance dans l’image. Ce modèle simple offre une alternative efficace aux modèles basés sur un grand ensemble de couches et incorporant des détecteurs spécifiques pour la forme ou le mouvement. Nous demontrons que l’approche proposée produit des résultat compatibles avec différentes experiences menées en psychophysique non seulement pour la perception mouvement global résultante mais aussi our la dynamique d’intégration du mouvement. Elle est egalement capable d’expliquer différentes propriétés de l’intégration sélective du mouvement des neurones MT. En définitive, ce papier propose un modèle d’integration du mouvement amélioré et numérique simulable capable de reproduire les aspects clés de l’intégration du mouvement. Mots-clés : dynamique, forme, GPGPU, mouvement, perception in ria -0 03 60 27 7, v er si on 2 10 J un 2 00 9 A neural model of luminance-gated recurrent motion diffusion for 2D motion 3
منابع مشابه
Modelling the dynamics of motion integration with a new luminance-gated diffusion mechanism
The dynamics of motion integration show striking similarities when observed at neuronal, psychophysical, and oculomotor levels. Based on the inter-relation and complementary insights given by those dynamics, our goal was to test how basic mechanisms of dynamical cortical processing can be incorporated in a dynamical model to solve several aspects of 2D motion integration and segmentation. Our m...
متن کاملMechanisms of Adaptive Spatial Integration in a Neural Model of Cortical Motion Processing
In visual cortex information is processed along a cascade of neural mechanisms that pool activations from the surround with spatially increasing receptive fields. Watching a scenery of multiple moving objects leads to object boundaries on the retina defined by discontinuities in feature domains such as luminance or velocities. Spatial integration across the boundaries mixes distinct sources of ...
متن کاملImage segmentation based on motion/luminance integration and oscillatory correlation
An image segmentation method is proposed based on the integration of motion and luminance information. The method is composed of two parallel pathways that process motion and luminance, respectively. Inspired by the visual system, the motion pathway has two stages. The first stage estimates local motion at locations with reliable information. The second stage groups locations based on their mot...
متن کاملAn Oscillatory Correlation Model of Human Motion Perception
An oscillatory correlation model of human motion perception is proposed based on the integration of motion and luminance information. The model is composed of two parallel pathways that segment the input scene based on motion and luminance, respectively. Combining these segmentations, the model re nes the motion estimates in the integration stage to obtain the nal segmentation in the motion pat...
متن کاملThe use of chromatic information for motion segmentation: differences between psychophysical and eye-movement measures.
Previous psychophysical studies have shown that chromatic (red/green) information can be used as a segmentation cue for motion integration. We investigated the mechanisms mediating this phenomenon by comparing chromatic effects (and, for comparison, luminance effects) on motion integration between two measures: (i) directional eye movements with the notion that these responses are mediated main...
متن کامل